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(54) MAP decoder with correction function in LOG-MAX approximation 



(57) A decoder and a decoding method can perform 
log-sum corrections by means of linear approximation. 
The decoder and decoding method provide improved 
decoding speed, with a reduced circuit dimension with- 
out adversely affecting the decoding performance of the 
circuit. The decoder comprises a linear approximation 
circuit 68 added to obtain log likelihoods and adapted to 
compute the correction term expressed by a one-dimen- 
sional function of a variable by linear approximation. The 
linear approximation circuit 68 computes the correction 



term by log-sum corrections by means of linear approx- 
imation using function F = -a P - Q + b, where the coef- 
ficient -a representing the gradient of the function and 
the coefficient b representing the intercept are ex- 
pressed by a power exponent of 2. More specifically, 
when the coefficients a and b are expressed respective- 
ly by -2-k and 2m -1 , the linear approximation circuit 68 
discards from the lowest bit the 
k-th lowest bits, bit-shifts the absolute value data P - Q 
and then inverts the m bits from the k+1 -th lowest bit to 
the m+k-th lowest bit by means of inverter 91 . 
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Description 

BACKGROUND OF THE INVENTION 
s Field of the Invention 

[0001] This invention relates to a decoder and a decoding method. 
Related Background Art 

10 

[0002] There have been many studies in recent years for minimizing symbol error rates by obtaining soft-outputs for 
the decoded outputs of inner codes of concatenated codes or the outputs of recursive decoding operations using a 
recursive decoding method. There have also been studies for developing decoding methods that are adapted to pro- 
ducing soft-outputs. For example, Bahl, Cocke, Jelinek and Raviv, "Optimal decoding of linear codes for minimizing 

15 symbol error rates", IEEE Trans. Inf. Theory, vol. lt-20, PP. 284-287, Mar. 1 974 describes an algorithm for minimizing 
symbol error rates when decoding predetermined codes such as convolutional codes. The algorithm will be referred 
to as BCJR algorithm hereinafer. The BCJR algorithm is designed to output not each symbol but the likelihood of each 
symbol as a result of decoding operation. Such an outputs is referred to as soft-output. The BCJR algorithm will be 
discussed below firstly by referring to FIG. 1 . It is assuemd that digital information is put into convolutional codes by 

20 encoder 201 of a transmitter (not shown), whose output is then input to a receiver (not shown) by way of a memoryless 
channel 202 having noises and decoded by decoder 203 of the receiver for observation. 

[0003] The M states (transitional states) representing the contents of the shift registers of the encoder 201 are de- 
noted by integer m (m = 0, 1 , M-1 ) and the state at time t is denoted by S t . If information of k bits is input in a time 
slot, the input at time t is expressed by means of i t = (i t1 , i^, i tk ) and the input system is expressed by means of l^ 

25 = j 2t hp). |f there is a transition from state m' to state m, the information bits corresponding to the transition are 
expressed by means of i (m', m) = (i-, (m\ m), i 2 (m\ m), i k (m\ m)). Additionally, if a code of n bits is output in a time 
slot, the output at time t is expressed by means of x t = (x t1 , x^, x^) and the output system is expressed by means 
of X., T = (x 1 , x 2 , .... x T ). If there is a transition from state m 1 to state m, the information bits corresponding to the transition 
are expressed by means of x (nrT, m) = (x 1 (rrT, m), x 2 (m', m), .... x k (m\ m)). 

30 [0004] The encoder 201 starts to produce convolutinal codes at state S 0 = 0 and ends at state S T = 0 after outputting 
X^ T . The inter-state transition probabilities P t (m lm') of the above encoder are defined by formula (1) below; 



35 



40 



P t {m\m l ) = Pr{S f = mlS M = m'} (1) 

where Pr {A IB} at the right side of the above equation represents the conditional probability with which A occurs under 
the conditions in which B occurs. The transition probabilities P t (m nY) are equal to the probability Pr{i t = i} that input 
i t at time t is equal to i when a transition from state m' to state m occurs with input i as shown by formula (2) below. 

P^m/m) = Pr{ i t = i] (2) 



[0005] The memoryless channel 202 having noises receives X^ T as input and outputs Y^. If a received value of n 
bits is output in a time slot, the output at time t is expressed by means of y t = (y t1 , y^, y tk ) and the output system is 
expressed by means of Y 1 T = (y 1f y 2 , y T ). Then, the transition probabilities of the memoryless channel 202 having 
noises can be defined for all values of t (1 < t < T) by using the transition probability of each symbol, or Pr I Xj). 

^^ii--n4^i -(3) 



55 



[0006] Now, Xjj is defined by formula (4) below as the likelihood of input information at time t when Y., T is received, 
or the soft-output to be obtained. 
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[0007] With the BCJR algorithm, probabilities 04, ft and y t are defined respectively by means of formulas (5) through 

(7) below. Note that Pr {A ; B} represents the probability with which both A and B occur. 

a,(ro) = Pr{S, = m; yJ] (5) 
p,(/r?)=Pr{Y / r +1 IS / =m} (6) 

y t (m\m) = Pr{S, = m;y t IS M = m'} (7) 

[0008] Now, the probabilities of 04, ft and Yt will be described by referring to FIG. 2, which is a trellis diagram, or a 
state transition diagram, of the encoder 201 . Referring to FIG. 2, 04^ corresponds to the passing probability of each 
state at time t-1 as computed on a time series basis from the state of starting the coding S 0 = 0 by using the received 
value and ft corresponds to the passing probability of each state at time t as computed on an inverse time series basis 
from the state of ending the coding S T = 0 by using the received value, while y t corresponds to the reception probability 
of the output of each branch showing a transition from a state to another at time t as computed on the basis of the 
received value and the input probability. 

[0009] Then, the soft-output is expressed in terms of the probabilities 04, ft and y t in a manner as shown in formula 

(8) below. 



ni,m 
ntjn 



[0010] Meanwhile, formula (9) below holds true for t = 1 , 2, T. 



45 oc t {m) = X a t ^{m')y t (rri\m) 



m'=Q 



..(9) 



where ocq(0) = 1 , OQ(m) = 0{m * 0) 
[0011] Similarly, formula (10) holds true also fort = 1, 2, .... T. 



7W' = 0 



.(10) 



where p^O) = 1, p^/r?) = 0(m *.0) 
[0012] Finally, formula (11) holds true for y t . 
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y t (m 9 9 m) 



' PAm\m}Vr{y,\jtm\m)} 

= Pr{z, = i(m\m)}Pr{yMm\m)} 
:*1 



...(11) 



0 



:*2 



: *1. 



when 



a transition occurs from m' to m with input i. 



: *2... when 



no transition occurs from m' to m with input i. 



[0013] Thus, for soft-output decoding, applying the BCJR algorithm, the decoder 203 determines the soft-output \ 
by passing through the steps shown in FIG. 3, utilizing the above relationships. 

[0014] More specifically, in Step S201 , the decoder 203 computes the probabilities 04 (m) and y t (m\ m), using the 
formulas (9) and (11) above, each time it receives y t . 

[0015] Then, in Step S202, after receiving all the system Y-, T , the decoder 203 computes the probability fa (m) of 
state m for ali values of time t, using the formula (10) above. 

[001 6] Thereafter, in Step S203, the decoder 203 computes the soft-output \ at each time t by substituting the values 
obtained in Steps S201 and S202 for the probabilities 04, fa and y t in the formula (8) above. 

[0017] With the above described processing steps, the decoder 203 can carry out the soft-output decoding, applying 
the BCJR algorithm. 

[0018] However, the BCJR algorithm is accompanied by a problem that it involves a large volume of computational 
operations because it requires to directly hold probabilities as values to be used for computations and employ multi- 
plications. As an attempt for reducing the volume of computational operations, Robertson, Villebrun and Hoeher, "A 
Comparison of Optimal and sub-optimal MAP decoding algorithms operating in the domain", IEEE Int. Conf. On Com- 
munications, pp. 1009-1013, June 1995, proposes Max-Log-MAP Algorithm and Log-MAP Algorithm (to be referred 
to as Max-Log-BCJR algorithm and Log-BCJR algorithm respectively hereinafter). 

[0019] Firstly, Max-Log-BCJR algorithm will be discussed below. With the Max-Log-BCJR algorithm, the probabilities 
04, p t and y t are expressed in terms of natural logarithm so that the multiplications for determining the probabilities are 
replaced by a logarithmic addition as expressed by formula (12) below and the logarithmic addition is approximated 
by a logarithmic maximizing operation as expressed by formula (13) below. Note that in the formula (13), max (x, y) 
represents a function for selecting either x and y that has a larger value. 



[0020] For simplification, the natural logarithm is expressed by means of I and values 04, p t , Yt and \ are expressed 
respectively by means of I04, \fa, ly t and in the domain of the natural logarithm as shown in formula (14) below. 



log(e x *e / )=x+y 



(12) 



log(e* + e?) = max(x,y) 



(13) 
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[0021] With the Max-Log-BCJR algorithm, the log likelihoods I04, Ift, ly t are approximated by using formulas (15) 
through (17) below. Note that the maximum value max in state m' at the right side of the equation of (1 5) is determined 
in state nrV showing a transition to state m. Similarly, the maximum value max in state m' at the right side of the equation 
of (1 6) is determined in state m 1 showing a transition to state m. 



Ia t (m) = max(/a, M (/n , )+ Iy t {m\m^) ...(15) 

10 

Ifiim) = max(/£ +1 M + Iy l+i (m,m')) -(16) 

m 

15 

h t (m',m) = log(Pr{/,= i{m\m))) + log(Pr{y,lx(/T7',m)}) (17) 



[0022] With the Max-Log-BCJR algorithm, logarithmic soft-output IA^ is also approximated by using formula (18) 
below. Note that, in the equation of (18), the maximum value max of the first term at the right side is determined in 
state rrT showing a transition to state m when "1 " is input and the maximum value max of the second term at the right 
side of the above equation is determined in state rrT showing a transition to state m when "0" is input. 



25 



30 



35 



50 



IX tj = max (la t _ x {rr() \ I/ f ( m ^ m ) Jr Ifi( m )) 

ffi'.m 

ij (m\m)= 1 

- max (/«,_, {m')+ Iy\m' ,m)+ P,{m)) 



[0023] Thus, for soft-output decoding, applying the Max-Log-BCJR algorithm, the decoder 203 determines soft-out- 
put \ by passing through the steps shown in FIG. 4, utilizing the above relationships. 

[0024] More specifically, in Step S211 , the decoder 203 computes the log likelihoods Ictt (m) and ly t (m\ m), using 
the formulas (15) and (17) above, each time it receives y t . 
[0025] Then, in Step S212, after receiving ail the system Y/, the decoder 203 computes the log likelihood ip t (m)of 
state m for all values of time t, using the formula (1 6) above. 

[0026] Thereafter, in Step S213, the decoder 203 computes the log soft-output IXt at each time t by substituting the 
40 values obtained in Steps S211 and S212 for the log likelihoods Ictf, lp t and ly t in the formula (18) above. 

[0027] With the above described processing steps, the decoder 203 can carry out the soft-output decoding, applying 
the Max-Log-BCJR algorithm. 

[0028] As pointed out above, since the Max-Log-BCJR algorithm does not involve any multiplications, it can greatly 
reduce the volume of computational operations if compared with the BCJR algorithm. 
45 [0029] Now, the Log-BCJR algorithm will be discussed below. The Log-BCJR algorithm is devised to improve the 
accuracy of approximation of the Max-Log-BCJR algorithm. More specifically, in the Log-BCJR algorithm, a correction 
term is added to the addition of probabilities of the formula (13) to obtain formula (19) below so that the sum of the 
addition of the formula (1 9) may represent a more accurate logarithmic value. The correction is referred to as log-sum 
correction hereinafter. 



log(e x + €?) = max(x,y)+ log(1+ e"'*" yl ) 



(19) 



[0030] The logarithmic operation of the left side of the equation (19) is referred to as log-sum operation and, for the 
purpose of convenience, the operator of a log-sum operation is expressed by means of "#" as shown in formula (20) 
below to follow the numeration system described in S. S. Pietrobon, "Implementation and performance of a turbo/MAP 
decoder, Int. J. Satellite Commun., vol. 16, pp. 23-46, Jan-Feb. 1998". Then, the operator of a cumulative addition is 
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expressed by means of "ftZ" as shown in formula (21) below (although it is expressed by means of "E" in the above 
paper). 

x#y=log(e x + e?) (20) 



#Z*i = ((-((^#*>^)..)#^-i) -(21) 

[0031] By using the operator, the log likelihoods loj and lp t and the log soft-output IX^ can be expressed respectively 
in a manner as shown in formulas (22) through (24) below. Since the log likelihood ly t is expressed by the formula (17) 
above, it will not be described here any further. 



Ia,(m) =#'Z {la t _ x {rrt)+Iy t (m\m)) - (22) 

m'=0 



+ -(23) 

m'=0 



a tJ (m) =# £ (/a M («') + /r,(«'.*)+ ifl(ro)) 

/,{<»',»/)= I 

(24) 

- # I KW+ /r,(*'.»»)+ ifrM) 

m',m 

/ y (m>i)=0 

[0032] Note that the cumulative addition of the log-sum operations in state rrT at the right side of the equation of (22) 
is determined in state m' showing a transition to state m. Similarly, the cumulative addition of the log-sum operations 
in state m' at the right side of the equation of (23) is determined in state m' showing a transition to state m. In the 
equation of (24), the cumulative addition of the log-sum operations at the first term of the right side is determined in 
state m' showing a transition to state m when the input is "1" and the cumulative addition of the log-sum operations at 
the second term of the right side is determined in state m' showing a transition to state m when the input is "0". 
[0033] Thus, for soft-output decoding, applying the Log-BCJR algorithm, the decoder 203 determines soft-output 
by passing through the steps shown in FIG. 4, utilizing the above relationships. 

[0034] More specifically, in Step S211, the decoder 203 computes the log likelihoods I04 (m) and ly t (m 1 , m), using 
the formulas (22) and (1 7) above, each time it receives y t . 

[0035] Then, in Step S212, after receiving all the system Y^, the decoder 203 computes the log likelihood Ift (m) 
of state m for all values of time t, using the formula (23) above. 

[0036] Thereafter, in Step S213, the decoder 203 computes the log soft-output at each time t by substituting the 

values obtained in Steps S211 and S212 for the log likelihoods [04, ip t and ly t in the formula (24) above. 

[0037] With the above described processing steps, the decoder 203 can carry out the soft-output decoding, applying 

the Log-BCJR algorithm. Since the correction term that is the second term at the right side of the above equation of 

(19) is expressed in a one-dimensional function relative to variable Ix - yl, the decoder 203 can accurately calculate 

probabilities when the values of the second term are stored in advance in the form of a table in a ROM (Read-Only 

Memory). 
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[0038] By comparing the Log-BCJR algorithm with the Max-Log-BCJR algorithm, it will be seen that, while it entails 
an increased volume of arithmetic operations, it does not involve any multiplications and the output is simply the log- 
arithmic value of the soft-output of the BCJR algorithm if the quantization error is disregarded. 
[0039] Meanwhile, methods that can be used for correcting the above described log-sum includes the secondary 

5 approximation method of approximating the relationship with variable Ix - yl by so-called secondary approximation and 
the interval division method of arbitrarily dividing variable Ix - yl into intervals and assigning predetermined values to 
the respective intervals in addition to the above described method of preparing a table for the values of the correction 
term. These log-sum correction methods are developed by putting stress on the performance of the algorithm in terms 
of accurately determining the value of the correction term. However, they are accompanied by certain problems includ- 

10 ing a large circuit configuration and slow processing operations. 

[0040] Therefore, studies are being made to develop high speed log-sum correction methods. Such methods include 
the linear approximation method of linearly approximating the relationship with variable Ix - yl and/or the threshold 
value approximation method of determining values for predetermined intervals of variable Ix - yl respectively by using 
predetermined threshold values. 

15 [0041] The linear approximation method is designed to approximate function F = log {1 + e A (-Ix - yl)} as indicated 
by curve C in FIG. 5A by a linear function as indicated by straight line L. The straight line L in FIG. 5A is expressed by 
means of equation F = -0.3 (Ix - yl) + log 2 and the correction term shows a degree of degradation of about 0.1 dB. 
[0042] On the other hand, the threshold value approximation method is designed to approximate function F = log {1 
+ e A (-Ix - yl)} as indicated by curve C in FIG. 5B by a step function as indicated by curve T. The curve T in FIG. 5B 

20 is expressed in a function that gives log 2 for the interval of 0 < Ix - yl < 1 and 0 for the interval of Ix - yl > 1 . The 
correction term shows a degree of degradation of about 0.2dB. 

[0043] Thus, while various methods have been discussed for the purpose of log-sum correction, all of them still have 
something to be improved. 

25 BRIEF SUMMARY OF THE INVENTION 

[0044] Various aspects and features of the present invention are defined in the appended. 

[0045] In view of the above identified circumstances, embodiments of the present invention can provide a decoder 
and a decoding method that can perform log-sum corrections by means of linear approximation, putting stress on 

30 speed, with a reduced circuit dimension without adversely affecting the decoding performance of the circuit. 

[0046] In an aspect of the invention, there is provided a decoder for determining the log likelihood logarithmically 
expressing the probability of passing a given state on the basis of the received value regarded as soft- input and de- 
coding the input by using the log likelihood, said decoder comprising a linear approximation means for calculating a 
correction term to be added to the log likelihood, the correction term being expressed in a one-dimensional function 

35 relative to a variable said linear approximation means being adapted to compute said correction term using a coefficient 
representing the gradient of said function for multiplying said variable, the coefficient being expressed as a power 
exponent of 2. 

[0047] Thus, a decoder according to the invention computes the correction term expressed in a one-dimensional 
function by means of a power exponent of 2. 
40 [0048] In another aspect of the invention, there is provided a decoding method for determining the log likelihood 
logarithmically expressing the probability of passing a given state on the basis of the received value regarded as soft- 
input 

and decoding the input by using the log likelihood, said decoding method comprising a linear approximation step for 
calculating a correction term to be added to the log likelihood, the correction term being expressed in a one-dimensional 
45 function relative to a variable, said linear approximation step being adapted to compute said correction term using a 
coefficient representing the gradient of said function for multiplying said variable, the coefficient being expressed as a 
power exponent of 2. 

[0049] Thus, a decoding method according to the invention is used to compute the correction term expressed in a 
one-dimensional function by means of a power exponent of 2. 

so [0050] As described above, a decoder for determining the log likelihood logarithmically expressing the probability of 
passing a given state on the basis of the received value regarded as soft-input and decoding the input by using the 
log likelihood according to the invention comprises a linear approximation means for a calculating a correction term to 
be added to the log likelihood, the correction term being expressed in a one-dimensional function relative to a variable, 
said linear approximation means being adapted to compute said correction term using a coefficient representing the 

55 gradient of said function for multiplying said variable, the coefficient being expressed as a power exponent of 2. 

[0051 ] Therefore, a decoder according to the invention computes the correction term expressed in a one-dimensional 
function by means of a power exponent of 2. Thus, it can realize a high or at least improved speed of operation without 
adversely affecting the decoding performance of the circuit. 
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[0052] A decoding method for determining the log likelihood logarithmically expressing the probability of passing a 
given state on the basis of the received value regarded as soft-input and decoding the input by using the log likelihood 
according to the invention comprises a linear approximation step for a calculating a correction term to be added to the 
log likelihood, the correction term being expressed in a one-dimensional function relative to a variable, said linear 

5 approximation step being adapted to compute said correction term using a coefficient representing the gradient of said 
function for multiplying said variable, the coefficient being expressed as a power exponent of 2. 
[0053] Therefore, a decoding method according to the invention is used to compute the correction term being ex- 
pressed in a one-dimensional function by means of a power exponent of 2. Thus, it can realize a high or at least 
improved speed of operation without adversely affecting the decoding performance of the circuit. 

10 [0054] The invention will now be described by way of example with reference to the accompanying drawings, through- 
out which like parts are referred to by like references, and in which: 

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING 

is [0055] 

FIG. 1 is a schematic block diagram of a communication model; 

FIG. 2 is a schematic trellis diagram of a conventional encoder, illustrating the contents of probabilities o^, p t and y t ; 
FIG. 3 is a flow chart illustrating the processing steps of a conventional decoder for decoding a soft-output by 
20 applying the BCJR algorithm; 

FIG. 4 is a flow chart illustrating the processing steps of a conventional decoder for decoding a soft-output by 
applying the Max-Log-BCJR algorithm; 

FIG. 5A is a graph illustrating a function having a correction term and an approximating function using a linear 
approximation technique; 

25 FIG. 5B is a graph illustrating a function having a correction term and an approximating function using a threshold 

value approximation technique; 

FIG. 6 is a schematic block diagram of a communication model to which a data transmission/reception system 
comprising an embodiment of the invention is applied; 

FIG. 7 is a schematic block diagram of the encoder of the data transmission/reception system of FIG. 6; 
30 FIG. 8 is a schematic illustration of the trellis of the encoder of FIG. 6; 

FIG. 9 is a schematic block diagram of the decoder of the data transmission/reception system of FIG. 6; 

FIG. 10 is a schematic block diagram of the la computation/storage circuit of the decoder of FIG. 9, illustrating the 

circuit configuration; 

FIG. 1 1 is a schematic block diagram of the la computation circuit of the la computation/storage circuit of FIG. 10, 
35 illustrating the circuit configuration; 

FIG. 1 2 is a schematic block diagram of the ip computation/storage circuit of the decoder of FIG. 9, illustrating the 
circuit configuration; 

FIG. 13 is a schematic block diagram of the l|3 computation circuit of the Ip computation/storage circuit of FIG. 1 2, 
illustrating the circuit configuration; 
^o FIG. 14 is a schematic block diagram of the addition/comparison/selection circuit of the la computation circuit or 

the Ip computation circuit, illustrating the circuit configuration; 

FIG. 1 5 is a schematic block diagram of the absolute value computation circuit of the addition/comparison/selection 
circuit of FIG. 14, illustrating the circuit configuration; 

FIG. 16 is a graph showing the relationship between a function having a correction term and a function that can 
45 be used by the linear approximation circuit of the addition/comparison/selection circuit of FIG. 1 4 for linear approx- 

imation, illustrating the operation of log-sum correction of the circuit. 

FIG. 17 is a schematic block diagram of a linear approximation circuit that can be used for the purpose of the 
invention, illustrating the configuration of the circuit for computing the value of the correction term, where the 
coefficient -a of function F = -a IP - Ql + b is expressed by using a power exponent of 2; 
so FIG. 18 is a schematic block diagram of another linear approximation circuit that can be used for the purpose of 

the invention, illustrating the configuration of the circuit for computing the value of the correction term, where the 
coefficients -a and b of function F = -a P - Ql + b are expressed by using power exponent of 2; and 
FIGS. 19A and 19B are schematic illustrations of the computational operation of the linear approximation circuit 
of FIG. 18. 

55 

DETAILED DESCRIPTION OF THE INVENTION 



[0056] Now, the present invention will be described by referring to the views of the accompanying drawings that 
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illustrate preferred embodiments of the invention. 

[0057] FIG. 6 is'a schematic block diagram of a communication model to which a data transmission/reception system 
comprising an embodiment of the invention is applied. More specifically, the data transmission/reception system in- 
cludes a transmission unit (not shown) comprising an encoder 1 for putting digital information into convolutional codes, 

5 a memoryless communication channel 2 having noises and adapted to transmitting the output of the transmission unit 
and a reception unit (not shown) comprising a decoder 3 for decoding the convolutional codes from the encoder 1 . 
[0058] In the data transmission/reception system, the decoder 3 is adapted to decode the convolutional codes output 
from the encoder 1 on the basis of the maximum a posteriori probability (to be referred to as MAP hereinafter) obtained 
by using the Max-Log-MAP algorithm or the Log-MAP algorithm (to be respectively referred to as the Max-Log-BCJR 

10 algorithm or the Log-BCJR algorithm hereinafter) as described in Robertson, Villebrun and Hoeher, "A Comparison of 
Optimal and Sub-Optimal MAP Decoding Algorithms Operating in the Log Domain", IEEE Int. Conf. On Communica- 
tions, pp. 1009-1013, June 1995. More specifically, it is adapted to determine the log likelihoods of loc^ l(3 t and ly t and 
the log soft-output IX^ that are logarithmic expressions of probabilities 04, (3 t and y t and soft output using the natural 
logarithm. 

15 [0059] In the following description, the M states (transitional states) representing the contents of the shift registers 
of the encoder 1 are denoted by integer m (m = 0, 1 , M-1) and the state at time t is denoted by S t . If information of 
k bits is input in a time slot, the input at time t is expressed by means of i t = (i t1 , i^, i tk ) and the input system is 
expressed by means of l^ = (i^ i 2 , i T ). If there is a transition from state m' to state m, the information bits corre- 
sponding to the transition are expressed by means of i (m\ m) = (i 1 (m\ m), i 2 (m\ m) i k (m\ m)). Additionally, if a 

20 code of n bits is output in a time slot, the output at time t is expressed by means of Xf= (x t1 , x^, .... x tk ) and the output 
system is expressed by means of X 1 T = (x 1t x 2 , x T ). If there is a transition from state m' to state m, the information 

bits corresponding to the transition are expressed by means of x (m\ m) = (x 1 (m\ m), x 2 (m\ m) x n (m\ m)). The 

memoryless communication channel 2 receives as input and outputs Y., T . If a received value of n bits is output in 
a time slot, the output at time t is expressed by means of y t = (y t1 , y^, y tn ) and the output system is expressed by 

25 means of = (y 1( y 2 , .... y T ). 

[0060] As shown in FIG. 7, the encoder 1 typically comprises three exclusive OR circuits 11, 13, 15 and a pair of 
shift registers 12, 14 and is adapted to carry out convolutional operations with a constraint length of "3". 
[0061] The exclusive OR circuit 11 is adapted to carry out an exclusive OR operation, using 1-bit input data i t1 and 
the data fed from the exclusive OR circuit 13 and supply the shift register 12 and the exclusive OR circuit 15 with the 

30 outcome of the operation. 

[0062] The shift register 1 2 keeps on feeding the 1 -bit data it holds to the exclusive OR circuit 1 3 and the shift register 
1 4. Then, the shift register 1 2 holds the 1 -bit data fed from the exclusive OR circuit 1 1 in synchronism with a clock and 
additionally feeds the 1-bit data to the exclusive OR circuit 13 and the shift register 14. 

[0063] The exclusive OR circuit 13 is adapted to carry out an exclusive OR operation, using the data fed from the 
35 shift registers 12, 14, and supply the exclusive OR circuit 11 with the outcome of the operation. 

[0064] The shift register 14 keeps on feeding the 1-bit data it holds to the exclusive OR circuits 13, 15. Then, the 
shift register 14 holds the 1-bit data fed from the shift register 12 in synchronism with a clock and additionally feeds 
the 1-bit data to the exclusive OR circuits 13, 15. 

[0065] The exclusive OR circuit 15 is adapted to carry out an exclusive OR operation, using the data fed from the 
40 exclusive OR circuit 11 and the data fed from the shift register 14, and then outputs the outcome of the operation as 
1 -bit output data x^ of 2-bit output data Xf externally. 

[0066] Thus, as the encoder 1 having the above described configuration receives 1-bit input data i t1 , it externally 
outputs the data as 1-bit input data x t1 that is a systematic component of 2-bit output data x t without modifying it and 
carries out a recursive convolutional operation on the input data i t1 . Then, it outputs externally the outcome of the 
45 operation as the other 1 -bit output data x^ of 2-bit output data x t . in short, the encoder 1 performs a recursive systematic 
convolutional operation with a coding ratio of "W and outputs externally output data ^ 

[0067] FIG. 8 illustrates the trellis of the encoder 1 . Referring to FIG. 8, each path indicated by a broken line shows 
a case where input data i t1 is "0" and each path indicated by a solid line shows a case where input data i t1 is "1 ". The 
label applied to each path indicates 2-bit output data x t . The states here are such that the contents of the shift register 
50 12 and those of the shift register 1 4 are sequentially arranged and the states "00", "10", "01 ", "11" are denoted respec- 
tively by state numbers "0", "1", "2", "3". Thus, the number of states M of the encoder 1 is four and the trellis has such 
a structure that there are two paths getting to the states in the next time slot from the respective states. In the following 
description, the states corresponding to the above state numbers are denoted respectively by state 0, state 1 , state 2, 
state 3. 

55 [0068] The coded output data x t of the encoder 1 are then output to the receiver by way of the memoryless commu- 
nication channel 2. 

[0069] On the other hand, as shown in FIG. 9, the decoder 3 comprises a controller 31 for controlling the various 
components of the decoder 3, an ly computation/storage circuit 32 operating as the first probability computing means 
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for'computing and storing log likelihood ly as the first log likelihood, an la computation/storage circuit 33 operating as 
the second probability computing means for computing and storing log likelihood la as the second log likelihood, an 
Ip computation/storage circuit 34 operating as the. third probability computing means for computing and storing log 
likelihood lp as the third log likelihood and a soft-output computation circuit 35 operating as soft-output computing 
s means for computing log soft-output \\. The decoder 3 estimates the input data i t1 of the encoder 1 by determining 
the log soft-output l^ from the received value y t showing an analog value under the influence of the noises generated 
on the memoryless communication channel 2 and hence regarded as soft-output. 

[0070] The controller 31 supplies control signals SCy, SCaand SCp respectively to the ly computation/storage circuit 
32, the la computation/storage circuit 33 and the ip computation/storage circuit 34 to control these circuits. 
10 [0071] The I y computation/storage circuit 32 carries out the operation of formula (25) below for each received value 
y t under the control of the control signal SCy fed from the controller 3 1 , using the received value y t and a priori probability 
information Pr t , to compute the log likelihood ly t at time t and stores the obtained log likelihood. In short, the ly compu- 
tation/storage circuit 32 computes the log likelihood ly expressing the probability y in the log domain as determined for 
each received value y t on the basis of the code output pattern and the received value. 

15 

ly t (m',m) = log(Pr{/, = i(m\m)})+ log(Pr{y,l x(m\ m)}) (25) 



20 



25 



[0072] The a priori probability Pr t is obtained as probability Pr {i t1 = 1} that each of input data i t1 , i t1 are equal to "1" 
or probability Pr = 0} that each of input data \ v i t1 are equal to "0" as indicated by formula (26) below. The a priori 
probability Pr t can alternatively be obtained as probability Pr {i t1 = 1 } or probability Pr {i t1 = 0} by inputting the natural 
log value of the log likelihood ratio of probability Pr = 1} to Pr {i t1 = 0}, considering the fact that the sum of the 
probability Pr {i t1 = 1} and the probability Pr {i t1 = 0} is equal to "1". 



Pr, = 



30 



log Pr /„ = l} 

( ) ••(26) 
logPrj/,, =0} 



[0073] The ly computation/storage circuit 32 supplies the log likelihood ly t it stores to the la computation/storage 
circuit 33, the Ip computation/storage circuit 34 and the soft-output computation circuit 35. More specifically, the ly 
computation/storage circuit 32 supp lies the log likelihood ly t to the la computation/storage circuit 33, the ip computation/ 
35 storage circuit 34 and the soft-output computation circuit 35 in a sequence good for the processing operations of these 
circuits. In the following description, the log likelihood ly t supplied from the ly computation/storage circuit 32 to the la 
computation/storage circuit 33 is expressed by means of ly(a), the log likelihood ly t supplied from the ly computation/ 
storage circuit 32 to the Ip computation/storage circuit 34 is expressed by means of ly (P1 ), ly (p2) and the log likelihood 
ly t supplied from the ly computation/storage circuit 32 to soft-output computation circuit 35 is expressed by means of 

[0074] The la computation/storage circuit 33 carries out the operation of formula (27) below under the control of the 
control signal SCa fed from the controller 31 , using the log likelihood ly (a) fed from the ly computation/storage circuit 
32 to compute the log likelihood I04 at time t and stores the obtained log likelihood. In the formula (27), operator "#" 
denotes the so-called log-sum operation for the log likelihood of transition from state m' to state m with input "0" and 

45 the log likelihood of transition from state m" to state m with input "1". More specifically, the la computation/storage 
circuit 33 computes the log likelihood lo^ at time t by carrying out the operation of formula (28). In other words, the la 
computation/storage circuit 33 computes the log likelihood la expressing in the log domain the probability a of transition 
from the coding starting state to each state as determined on a time series basis for each received value y t . Then, the 
la computation/storage circuit 33 supplies the log likelihood lo^ it stores to the soft-output computation circuit 35. At 

50 this time the la computation/storage circuit 33 supplies the log likelihood lo^ to the soft-output computation circuit 35 
in a sequence good for the processing operations of the circuit 35. In the following description, the log likelihood lo^ 
supplied from the la computation/storage circuit 33 to the soft-output computation circuit 35 is expressed by means of 
la (X). 



55 
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Ia t {m) = (ia^W + Iy t (m\m)) 

, . vX .-.(27) 

#(/<*,_,(/»") + Ir,(m",m)) 

Ia t {m) = max(/ar,_,(/w') + //,(> w '>> w XM-i(' w ") + Iy,( m " , m )) 
+ log(l + e -i( /ff f^( OT, ) + ^ ^ (< m ))••( ya M(« B )+^(«^«))lj 

*5 [0075] The ip computation/storage circuit 34 carries out the operation of formula (29) below under the control of the 
signal SCp fed from the controller 31 , using the log likelihoods ly (p1 ) and ly (p2) fed from the ly computation/storage 
circuit 32 to compute the log likelihoods ip t at time t of the two systems and stores the obtained log likelihoods. In the 
formula (29), operator "#" denotes the so-called log sum operation for the log likelihood of transition from state m' to 
state m with input "0" and the log likelihood of transition from state m" to state m with input "1". More specifically, the 

20 ip computation/storage circuit 34 computes the log likelihood ip t at time t by carrying out the operation of formula (30). 
I n other words, the Ip computation/storage 34 computes the log likelihood lp expressing in the log domain the probability 
p of inverse transition from the coding terminating state to each state as determined on a time series basis for each 
received value y t . Then, the ip computation/storage circuit 34 supplies the log likelihood ip t of one of the systems out 
of the log likelihoods \$ x it stores to the soft-output computation circuit 35. At this time the Ip computation/storage circuit 

25 34 supplies the log likelihood lp t to the soft-output computation circuit 35 in a sequence good for the processing oper- 
ations of the circuit 35. In the following description, the log likelihood ip t supplied from the ip computation/storage circuit 
34 to the soft-output computation circuit 35 is expressed by means of ip(X). 



30 



35 



7^M=(/^ +1 W+/r, + ,(w,m')) 



...(29) 



40 



+ log(l 4- e-i 1 ^™'* 1 *'^'™^ - C 30 ) 



[0076] The soft-output computation circuit 35 carries out the operation formula (31) below, using the log likelihood 
ly (X) fed from the ly computation/storage circuit 32 and the log likehood la (X) fed from the la computation/storage 
circuit 33, to compute the log soft-output l^ at time t and stores the obtained log soft-outputs. After rearranging the log 
45 soft-outputs IXj it sores, the soft-output computation circuit 35 outputs them externally. In the formula (31), operator 
denotes the cumulative addition of the so-called log sum operations using the above described operator "#". 



so 



m'jn 
;(m\m)=l 



55 



i(m',w)=0 



(31) 



[0077] The decoder 3 having the above described configuration computes the log likehood ly t (m* , m) by means of 
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the ly computation/storage circuit 32 and also the log likehood locj (m) by means of the la computation/storage circuit 
33 each time it receives as input the soft-input value y t received by the receiving unit. Upon receiving all the received 
values y t , the decoder 3 computes the log likelihood lp t for each state m for all the values of time t by means of the lp 
computation/storage circuit 34. Then, the decoder 3 computes the log soft-output \\ for each time t by means of the 
s soft-output computation circuit 35, using the obtained log likelihoods I04, iPt and ly t . In this way, the decoder 3 can 
operate for soft-output decoding by applying the Log-BCJR algorithm. 

[0078] Now, the decoder 3 operates with a reduced circuit size when computing the log likelihoods 104 and l(3 t by 
means of the la computation/storage circuit 33 and the lp computation/storage circuit 34. The la computation/storage 
circuit 33 and the lp computation/storage circuit 34 will be described in greater detail hereinafter. 

10 [0079] Firstly, the la computation/storage circuit 33 will be described. As shown in FIG. 10, the la computation/ 
storage circuit 33 comprises a selector 41 for selecting either the computed log likelihoods la or the initial value of the 
log likelihood Ioq, a register 42 for holding either the computed log likelihoods la or the initial value of the log likelihood 
la, an la computation circuit 43 for computing the log likelihood la in each state, RAMs (random access memories) 
44, 45 for sequentially holding the log likelihoods la of different states and a selection circuit 46 for selectively taking 

15 out the log likelihood la read out from the RAMs 44, 45. 

[0080] The selector 41 selects the initial value of the log likelihood Ioq at the time of initialization or the log likelihoods 
la fed from the la computation circuit 43 at any time except the time of initialization under the control of control signal 
SCafed from the controller 31 . The initialization occurs in the time slot immediately before the ly computation/storage 
circuit 32 starts outputting log likelihoods ly (a). If the decoder 3 realizes the time when the encoder 1 starts a coding 

20 operation, log 1 = 0 is given as initial value Ioq in state 0 whereas log 0 = -00 js given as initial value in any other state. 
If, on the other hand, the decoder 3 does not realize the time when the encoder 1 starts a coding operation, log (1/M), 
or log (1/4) in the above instance, is given in all states. However, what is essential here is that a same value is given 
in all states so that 0 may alternatively be given in all states. The selector 41 supplies the initial value Ioq or the log 
likelihoods la, whichever it selects, to the register 42. 

25 [0081] The register 42 holds the initial value Ioq or the log likelihoods la supplied from the selector 41 . Then, in the 
next time slot, the register 42 supplies the initial value Ioq or the log likelihoods la it holds to the la computation circuit 
43 and the RAMs 44, 45. 

[0082] Referring now to FIG. 11 , the la computation circuit 43 comprises addition/comparison/selection circuits, the 
number of which corresponds to the number of states. In the above instance, the la computation circuit 43 comprises 

30 four addition/comparison/selection circuits 47 0 , 47 1 , 47 2 and 47 3 . 

[0083] Each of the addition/comparison/selection circuits 47 0 , 47 1t 47 2 and 47 3 are fed with the log likelihoods ly t 
[00], ly t [10], ly t [01] and ly t [11] of the branches corresponding to the respective outputs "00", "10", "01" and "11" on 
the trellis as computed by the ly computation/storage circuit 32 on the basis of the transitions on the trellis and the log 
likelihoods slot loc^ (0), la^ (1), la^ (2), l^ (3) in all the sates in the immediately preceding time. Then, each of the 

35 addition/comparison/selection circuits 47 0 , 47 1? 47 2 and 47 3 determines the log likelihoods la in the next time slot in 
state 0, state 1 , state 2 and state 3. 

[0084] More specifically, the addition/comparison/selection circuits 47 0 receives the log likelihoods ly t [00], ly t [11] 
and the log likelihoods la^ (0), Ian (2) as inputs and determines the log likelihood lo^ (0) in state 0. 
[0085] Similarly, the addition/comparison/selection circuits 47 1 receives the log likelihoods ly t [11], ly t [00] and the 
40 log likelihoods la^ (0), la^., (2) as inputs and determines the log likelihood lo^ (1) in state 1 . 

[0086] Then, the addition/comparison/selection circuits 47 2 receives the log likelihoods ly t [10], ly t [01] and the log 
likelihoods la^ (1), la^ (3) as inputs and determines the log likelihood I04 (2) in state 2. 

[0087] Furthermore, the addition/comparison/selection circuits 47 3 receives the log likelihoods ly t [01], ly t [10] and 
the log likelihoods (04. n (1), la^ (3) as inputs and determines the log likelihood lo^ (3) in state 3. 
45 [0088] In this way, the la computation circuit 43 performs the computation of the formula (27) and hence that of the 
formula (28) above, using the log likelihoods ly (a) fed from the ly computation/storage circuit 32 and the initial value 
Ioq or the log likelihoods la in the immediately preceding time slot held by the register 42, to determine the log likelihoods 
la in all states in the next time slot. Then, the la computation circuit 43 supplies the computed log likelihoods la to the 
selector 41 . The addition/comparison/selection circuits 47 0 , 47-, , 47 2 and 47 3 will be described in greater detail here- 
to in after. 

[0089] The RAMs 44, 45 sequentially stores the log likelihoods la (0), la (1), la (2) and la (3) fed from the register 
42 under the control of the control signal SCafrom the controller 31 . If each of the log likelihoods la (0), la (1), la (2) 
and la (3) is expressed in 8 bits, the RAMs 44; 45 stores the log likelihoods la (0), la (1), la (2) and la (3) as a word 
of 32 bits. The log likelihoods la (0), la (1 ), la (2) and la (3) stored in the RAMs 44, 45 are then read out therefrom by 
55 selection circuit 46 in a predetermined sequence. 

[0090] The selection circuit 46 selectively takes out the log likelihoods la(0), la(1), la (2) or la (3) that are read from 
the RAMs 44, 45 and supplies it to the soft-output computation circuit 35 as log likelihood la (X) under the control of 
the control signal SCa from the controller 31 . 
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[0091] t Thus, the la computation/storage circuit 33 initializes in a time slot immediately before the ly computation/ 
storage circuit 32 starts outputting log likelihoods ly (a) and causes the register 42 to hold the initial value lag selected 
by the selector 41 . Then, in the subsequent clock cycles, the la computation/storage circuit 33 causes the la compu- 
tation circuit 43 to sequentially compute the log likelihoods la in the next time slot, using the log likelihoods ly(a) fed 

5 from the ly computation/storage circuit 32 and the log likelihoods la in the immediately preceding time slot fed from 
the register 42, and makes the register 42 store the log likelihoods la. Furthermore, the la computation/storage 33 
causes the RAMs 44, 45 to sequentially store the log likelihoods la (0), la (1 ), la (2) and la (3) in the respective states 
held in the register 42 and makes the selection circuit 46 to read them out in a predetermined sequence and supply 
them to the soft-output computation circuit 35 as log likelihoods la (X). 

10 [0092] Now, the l(3 computation/storage circuit 34 will be described. As shown in FIG. 1 2, the ip computation/storage 
circuit 34 comprises Ip computation circuits 51 v 51 2 for computing the log likelihoods ip in the states, selectors 52.,, 
52 2 for selecting either the computed log likelihoods Ip or the initial values of the log likelihoods ipa, ipb, registers 53 1 , 
53 2 for holding the initial values Ipa, Ipb or the log likelihoods ip and a selection circuit 54 for selectively taking out one 
of the log likelihoods fed from the registers 53.,, 53 2 . 

is [0093] Referring now to FIG. 13, each of the Ip computation circuits 51.,, 512 comprises addition/comparison/selec- 
tion circuits, the number of which corresponds to the number of states. Intheabove instance, each ofthe ip computation 
circuits 51.,, 51 2 comprises four addition/comparison/selection circuits 55 0 , 55 1( 55 2 and 55 3 . 

[0094] Each of the addition/comparison/selection circuits 55 0 , 55 19 55 2 and 55 3 are fed with the log likelihoods ly t 
[00], ly t [10], ly t [01], ly t [11] of the branches corresponding to the respective outputs "00", "10", "01", "11" on the trellis 
20 as computed on the basis of the transitions on the trellis by the ly computation/storage circuit 32 and the log likelihoods 
'Pt (°)> 'Pt 'Pt ( 2 ) and 'Pt ( 3 ) in 3,1 tne sates in tne immediately preceding time slot . Then, each of the addition/ 
comparison/selection circuits 55 0 , 55 1f 55 2 and 55 3 determines the log likelihoods Ip in the immediately preceding time 
slot in state 0, state 1 , state 2 and state 3. 

[0095] More specifically, the addition/comparison/selection circuits 55 0 receives the log likelihoods ly t [00], ly t [11] 
25 and the log likelihoods ip t (0), Ipt (1) as inputs and determines the log likelihood ip M (0) in state 0. 

[0096] Similarly, the addition/comparison/selection circuits 55 1 receives the log likelihoods ly t [10], ly t [01] and the 
log likelihoods lp t (2), Ipt (3) as inputs and determines the log likelihood lp t _ 1 (1) in state 1 . 

[0097] Then, the addition/comparison/selection circuits 55 2 receives the log likelihoods ly t [11], ly t [00] and the log 
likelihoods Ipj (0), ip t (1) as inputs and determines the log likelihood lp M (2) in state 2. 

30 [0098] Furthermore, the addition/comparison/selection circuits 55 3 receives the log likelihoods ly t [01], ly t [10] and 
the log likelihoods iPt (2), lp t (3) as inputs and determines the log likelihood iPt^ (3) in state 3. 
[0099] In this way, each of the Ip computation circuits 51-,, 51 2 performs the computation of the formula (29) and 
hence that of the formula (30) above, using the log likelihoods Iy(p1), ly (p2) fed from the ly computation/storage circuit 
32 and the initial values Ipa, Ipb or the log likelihoods Ip held by the registers 53 1 , 53 2 , to determine the log likelihoods 

35 |p in all states in the immediately preceding time slot. Each of the log likelihoods Ip (0), Ip (1 ), Ip (2), Ip (3) is expressed 
typically by 8 bits to make the total number of bits equal to 32. The ip computation circuits 51^512 respectively supply 
the computed log likelihoods Ip to the selectors 52 1 , 52 2 . The addition/comparison/selection circuits 55 0 , 55! , 55 2 and 
55 3 will be described in greater detail hereinafter. 

[0100] Each of the selectors 52 t , 52 2 selects the initial value of the log likelihood ipa or Ipb, whichever appropriate, 
40 at the time of initialization or the log likelihoods ip fed from the Ip computation circuit 51 1 or 51 2 , whichever appropriate, 
at any time except the time of initialization under the control of control signal SCp fed from the controller 31. The 
initialization occurs in the time slot immediately before the ly computation/storage circuit 32 starts outputting log like- 
lihoods ly (p1), ly (P2) and repeated in every cycle thereafter that is twice as long as the terminating length. While a 
same value such as 0 or log (1/M), or log (1/4) in this instance, is normally given as initial values Ipa, Ipb for all the 
45 states, log 1 = 0 is given as the value in the concluding state whereas log 0 = -°o is given in any other state when a 
concluded code is decoded. The selectors 52.,, 52 2 supplies respectively either the initial values Ipa, ipb or the log 
likelihoods Ip they select to the respective registers 53 1f 53 2 . 

[0101] The registers 53.,, 53 2 hold the initial values ipa, Ipb or the log likelihoods Ip supplied from the selectors 52 1( 
52 2 . Then, in the next time slot, the registers 53-,, 53 2 supply the initial values ipa, ipb or the log likelihoods Ip they 
50 hold to the Ip computation circuits 51 1f 51 2 and the selection circuit 54. 

[0102] The selection circuit 54 selectively takes out the log likelihoods Ip (0), Ip (1), Ip (2) or Ip (3) that are supplied 
from the registers 53 1( 53 2 and supplies it to the soft-output computation circuit 35 as log likelihood Ip (k) under the 
control of the control signal SCp from the controller 31 . 

[0103] Thus, the Ip computation/storage circuit 34 initializes in a time slot immediately before the ly computation/ 
55 storage circuit 32 starts outputting log likelihoods ly (p1) and in the subsequently cycle periods having a length twice 
as long as the terminating length and causes the register 53 1 to hold the initial value Ipa selected by the selector 52^ . 
Then, in the subsequent clock cycles, the Ip computation/storage circuit 34 causes the Ip computation circuit 51 1 to 
sequentially compute the log likelihoods ip in the immediately preceding time slot, using the log likelihoods ly (P1) fed 
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from the ly computation/storage circuit 32 and the log likelihoods Ip fed from the register 52 1 , and makes the register 

53 1 store the log likelihoods lp. 

[0104] Furthermore, the ip computation/storage circuit 34 initializes in a time slot immediately before the ly compu- 
tation/storage circuit 32 starts outputting log likelihoods ly (p2) and in the subsequently cycle periods having a length 
s twice as long as the terminating length and causes the register 53 2 to hold the initial value ipb selected by the selector 
52 2 . Then, in the subsequent clock cycles, the ip computation/storage circuit 34 causes the Ip computation circuit 51 2 
to sequentially compute the log likelihoods Ip in the immediately preceding time slot, using the log likelihoods ly (P2) 
fed from the ly computation/storage circuit 32 and the log likelihoods ip fed from the register 52 2> and makes the register 

53 2 store the log likelihoods ip. Then, the ip computation/storage circuit 34 causes the selection circuit 54 to read out 
10 the log likelihoods lp (0), ip (1), Ip (2) and Ip (3) in the respective states held in the registers 53.,, 53 2 in a predetermined 

sequence and supply them to the soft-output computation circuit 35 as log likelihoods ip (X). 

[0105] Now, the addition/comparison/selection circuits 47 0 , 47 1 , 47 2 and 47 3 that the la computation/storage circuit 
33 comprises and the addition/comparison/selection circuits 55 0 , 55.,, 55 2 and 553 that the ip computation/storage 
circuit 34 comprises will be described below. However, since the addition/comparison/selection circuits 47 0 , 47^ 47 2> 

15 47 3 , 55 0> 55-,, 55 2 and 55 3 have a same and identical configuration and only differ from each other in term of inputs 
they receive and outputs they send out. Therefore, in the following description, they will be collectively referred to as 
addition/comparison/selection circuit 60. Furthermore, in the following description, the two log likelihoods ly input to 
each of the four addition/comparison/selection circuits 47 0 , 47 1 , 47 2 and 47 3 and the two log likelihoods ly input to each 
of the four addition/comparison/selection circuits 55 0 , 55^ 55 2 and 55 3 are denoted respectively and collectively by I A 

20 and IB, whereas the two log likelihoods la input to each of the four addition/comparison/selection circuits 47 0> 47 1f 47 2 
and 47 3 and the two log likelihoods Ip input to each of the four addition/comparison/selection circuits 55 0 , 55^ 55 2 and 
55 3 are denoted respectively and collectively by IC and ID. Furthermore, the log likelihoods la output from each of the 
addition/comparison/selection circuits 47 0 , 47.,, 47 2 and 47 3 and the log likelihoods Ip output from each of the addition/ 
comparison/selection circuits 55 0 , 55 v 55 2 and 55 3 are collectively denoted by IE. In the following description, any 

25 probability is expressed by means of a value not smaller than 0 and a lower probability is expressed by means of a 
larger value by taking situations where a decoder according to the invention is assembled as hardware. 
[0106] As shown in FIG. 14, the addition/comparison/selection circuit 60 comprises adders 61 , 62 for adding two 
data, comparator circuits 63 for comparing the outputs of the adders 61 , 62 in terms of size, a selector 64 for selecting 
either one of the outputs of the adders 61 , 62, a correction term computation circuit 65 for computing the value correction 

30 term of the Log-BCJR algorithm and a differentiators 66 for obtaining the difference of the two data. 

[0107] The adder 61 is adapted to receive and add the log likelihoods IA, IC. If the addition/comparison/selection 
circuit 60 is the addition/comparison/selection circuit 47 0 , the adder 61 receives the log likelihood ly t [00] and the log 
likelihood la^ (0) as input and adds the log likelihood ly t [00] and the log likelihood lotn (0). The adder 61 then supplies 
the data obtained by the addition to the comparator circuit 63, the selector 64 and the correction term computation 

35 circuit 65. Note that, in the following description, the data output from the adder 61 is denoted by P. 

[0108] The adder 62 is adapted to receive and add the log likelihoods IB, ID. If the addition/comparison/selection 
circuit 60 is the addition/comparison/selection circuit 47 0 , the adder 62 receives the log likelihood ly t [11] and the log 
likelihood lo^.., (2) as input and adds the log likelihood ly t [1 1 ] and the log likelihood la^-, (2). The adder 62 then supplies 
the data obtained by the addition to the comparator circuit 63, the selector 64 and the correction term computation 

40 circuit 65. Note that, in the following description, the data output from the adder 62 is denoted by Q. 

[0109] The comparator circuit 63 compares the value of the data P fed from the adder 61 and the value of the data 
Q fed from the adder 62 to see which is larger. Then, the comparator circuit 63 supplies the information on the com- 
parison indicating the outcome of the comparison to the selector 64. 

[01 1 0] The selector 64 selects either the data P fed from the adder 61 or the data Q fed from the adder 62, whichever 
45 having a smaller value and hence showing a higher probability, on the basis of the information on the comparison 
supplied from the comparator circuit 63. Then, the selector 64 supplies the selected, data to the differentiator 66. It will 
be appreciated that the data selected by the selector 64 is same and identical with the first term of the right side of the 
equation (28) and that of the equation (30) shown above. 

[0111] The correction term computation circuit 65 comprises an absolute value computation circuit 67 for computing 
50 the absolute value of difference of the data P fed from the adder 61 and the data Q fed from the adder 62 and a linear 
approximation circuit 68 that operates as linear approximation means for computing the correction term by linear ap- 
proximation, using the absolute value computed by the absolute value computation circuit 67. The correction term 
computation circuit 65 computes the value of the correction term of the Log-BCJR algorithm or the value of the second 
term of the right side of the equation (28) or the equation (30) shown above. More specifically, the correction term 
55 computation circuit 65 expresses the correction term as a one-dimensional function of variable IP - Ql and computes 
the linearly approximated value in the form of -a IP - Ql + b that uses coefficient -a (a > 0) indicating the gradient of 
the function and coefficient b indicating the intercept of the function. Then, the correction term computation circuit 65 
supplies the data Z obtained by the computation to the differentiator 66. 
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[01 1 2] , The differentiator 66 determines the difference of the data selected by the selector 64 and the data 2 fed from 
the correction term computation circuit 65 and outputs the difference as log likelihood IE. For instance, if the addition/ 
comparison/selection 60 is the addition/comparison/selection circuit 47 0 , the differentiator 66 outputs the log likelihood 
Iot(0). 

5 [0113] Now, the estimation of the delay at the addition/comparison/selection circuit 60 will be discussed below. It is 
assumed here that the delay of a comparator circuit and that of a differentiator are same as that of an ordinary adder 
such as the adder 61 or 62. 

[0114] As clear from FIG. 1 4, the delay that is inevitable with the addition/comparison/selection 60 includes the delay 
due to the adders 61 , 62 which can be regarded as a single adder, the delay due to the comparator circuit 63 and the 
10 delay due to the differentiator 66. In other words, the addition/comparison/selection 60 involves the delay of at least 
three adders. 

[0115] Therefore, in order to minimize the delay of the addition/comparison/selection 60, it is necessary to minimize 
the delay due to the correction term computation circuit 65. Therefore, the delay due to the correction term computation 
circuit 65 will be estimated. 

15 [0116] Firstly, the delay of the absolute value computation circuit 67 will be estimated. As shown in FIG. 15, the 
absolute value computation circuit 67 is so regarded as to comprise a comparator 71 for comparting the two values 
output from the upstream two adders 61 , 62 to see which is larger, a pair of differentiators 72, 73 for determining the 
difference of the two data and a selector 74 for selecting one of the outputs of the differentiators 72, 73. 
[0117] More specifically, the absolute value computation circuit 67 compares the data P fed from the adder 61 and 

20 the data Q fed from the adder 62 by means of the comparator circuit 71 . At the same time, the absolute value compu- 
tation circuit 67 determines the difference (P - Q) of the data P and the data Q by means of the differentiator 72 and 
also the difference (Q - P) of the data Q fed from the adder 62 and the data P fed from the adder 61 by means of the 
differentiator 73. Then, the absolute value computation circuit 67 selects either the difference (P - Q) or the difference 
(Q - P), whichever showing a positive value, by means of the selector 74 on the basis of the information on the outcome 

25 of the comparison of the comparator circuit 71 and supplies the selected positive value of either the difference (P - Q) 
or the difference (Q - P) to the linear approximation circuit 68 as absolute value data IP - Ql. 

[0118] Thus, as the processing operation of the comparator circuit 71 and that of the differentiators 72, 73 are per- 
formed concurrently in the absolute value computation circuit 67, the absolute value computation circuit 67 involves 
the delay due to an adder and the delay due to a selector. 

30 [0119] As shown in FIG. 16, the linear approximation circuit 68 performs a log-sum correction by means of so-called 
linear approximation so as to approximate the function F = -a I P - Ql + b indicated by straight lines , L 2 to the function 
F = log {1 + e A (-IP - Ql)} indicated by curve C and computes the value of the correction term. More specifically, the 
linear approximation circuit 68 computes the value of the correction term at least by expressing the coefficient -a of 
function F = -alP-QI + b, using a power exponent of 2. Referring to FIG. 16, -a that is expressed by means of apower 

35 exponent of 2 may be -a = -2" 1 = -0.5 as indicated by straight line L., or -a = -2" 2 = -0.25 as indicated by straight line 
Lg. It is assumed here that -a = -0.25. Then, as shown in FIG. 1 7, the linear approximation circuit 68 is so regarded as 
to comprise a differentiator 81 , a comparator circuit 82 and a selector 83. 

[0120] The differentiator 81 computes the difference of the coefficient b representing the intercept of the function F 
= -a IP - Ql + b and the upper n-2 bits of the n-bit absolute value data IP - Ql fed from the absolute value computation 
40 circuit 67 and supplies the selector 83 with the difference. 

[01 21 ] The computation 82 compares the value of the coefficient b and that of data IP - Ql [n : 3] expressed by means 
of the upper n-2 bits of the absolute value data IP - Ql to see which is larger and supplies the selector 83 with information 
on the outcome of the comparison. 

[0122] The selector 83 selects either the data fed from the differentiator 81 or "0" on the basis of the information on 
45 the outcome of the comparison coming from the comparator circuit 82. More specifically, the selector 83 selects the 
data fed from the differentiator 81 when the outcome of the comparison of the comparator circuit 82 proves IP - Ql [n : 
3] < b, whereas it selects "0" when IP - Ql [n : 3] > b. Then, the selector 83 supplies the selected data to the . differentiator 
66 as data Z indicating the value of the correction term. 

[01 23] The linear approximation circuit 68 discards the lowest bit and the second lowest bit of the n-bit absolute value 
50 data IP - Ql fed from the absolute value computation circuit 67 and subtracts the data expressed by the remaining 

upper n-2 bits from the coefficient b. In other words, the linear approximation circuit 68 can multiply IP - Ql by 1/4 = 

0.25 by discarding the two lowest bits and bit-shifting the absolute value data IP - Ql and carry out the operation of - 

0.25 IP - Ql + b by subtracting the data expressed by the remaining upper n-2 bits from the coefficient b. 

[0124] Since the correction term shows a positive value, the linear approximation circuit 68 outputs "0" by means of 
55 the selector 83 and avoids the situation where the correction term takes a negative value if the comparator circuit 82 

finds out as a result of the comparison that the differentiator 81 outputs a negative value and hence the value of the 

correction term is computed as negative. 

[0125] If -a = -2' 1 = -0.5 is taken, the linear approximation circuit 68 discards the lowest bit of the absolute value data 
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IP - Ql for bit-shifting. Therefore, an appropriate number of lower bits of the absolute value data IP - Ql will be discarded 
depending on the power exponent to be used for expressing the coefficient -a. 

[01 26] Thus, the linear approximation circuit 68 does not require the use of any multiplier and involves only a process- 
ing operation of the differentiator 81 and that of the comparator circuit 82 that proceed concurrently. Therefore, the 
5 delay of the linear approximation circuit 68 can be estimated as that of a single adder and that of a single selector. 
[0127] The linear approximation circuit 68 may compute the value of the correction term also by using a power 
exponent of 2 to express the coefficient b. If the coefficient b is expressed by means of 2 m - 1 and -a = -0.25, the linear 
approximation circuit 68 can be so regarded as to comprise an inverter 91 , an OR gate 92 and a selector 93 as shown 
in FIG. 18. 

10 [0128] The inverter 91 inverts the m bits from the third lowest bit to the m+2-th lowest bit of the n-bit absolute value 
data IP -Ql fed from the absolute value computation circuit 67. Then, the inverter 91 supplies the data obtained as a 
result of the inversion to the selector 93. 

[0129] The OR gate 92 determines the exclusive OR of the upper n-m-2 bits from the m+3-th lowest bit to the n-th 
lowest bit of the n-bit absolute value data IP - Ql fed from the absolute value computation circuit 67. Then, the OR gate 

15 92 supplies the obtained exclusive OR to the selector 93. 

[0130] The selector 93 selects either the data fed from the inverter 91 or "0" on the basis of the exclusive OR fed 
from the OR gate 92. More specifically, the selector 93 selects the data fed from the inverter 91 when the exclusive 
OR fed from the OR gate 92 is equal to "0" but it selects "0" when the exclusive OR fed from the OR gate 92 is equal 
to "1 ". Then, the selector 93 supplies the selected data to the differentiator 66 as data Z indicating the correction term. 

20 [0131 ] Thus, the linear approximation circuit 68 discards the lowest bit and the second lowest bit of the n-bit absolute 
value data IP - Ql fed from the absolute value computation circuit 67 and inverts the m bits from the third lowest bit to 
the m+2-th lowest bit of the remaining upper n-2 bits by means of the inverter 91 . At the same time, the linear approx- 
imation circuit 68 determines the exclusive OR of the n-m-2 bits from the m+3-th lowest bit to the n-th bit by means of 
the OR gate 92. 

25 [0132] In other words, the linear approximation circuit 68 can multiply IP - Ql by 1/4 = 0.25 by discarding the two 
lowest bits and bit-shifting the absolute value data IP - Ql. Therefore, the linear approximation circuit 68 only needs to 
multiply the data IP - Ql [n : 3] expressed by means of the upper n-2 bits of the absolute value data IP - Ql, or 0.25 IP 
- Ql, by -1 and adds the coefficient b that is expressed by means of 2 m - 1 to the product. 

[0133] In order to express the arithmetic operations of the linear approximation circuit 68 by modus, 0.25 IP - Ql 

30 obtained by discarding the two lowest bits of the n-bit absolute value data IP - Ql is denoted by A = (A n , A n _., A^, 

A m+2 A 3 ) and the m bits from the third lowest bit to the m+2-th lowest bit and the n-m-2 bits from the m+3-th lowest 

bit to the n-th bit of the remaining upper n-2 bits are denoted respectively by A' and A" as shown in FIG. 1 9A. 
[0134] Firstly, it is assumed that "-0.25 IP - Ql + 2 m - 1 = -A + (2 m - 1 )" to be obtained by the linear approximation 
circuit 100 shows a negative value. Then, the equivalence relation as expressed by formula (32) below holds true. 
35 More specifically, A" shows a positive value when "-A + (2a m - 1)" shows a negative value. In other words, the exclusive 
OR of all the bits of A" is equal to "1" when "-A + (2 m - 1)" shows a negative value. 

-4 + (2 m -1)<0** A>2 m -1 

40 

<=*> A" > 0 (32) 

[0135] Now, it is assumed that "-0.25 IP - Ql + 2 m - 1 = -A + (2 m - 1)" to be obtained by the linear approximation 
circuit 68 shows a value not smaller than 0. Then, A" = 0 from the equivalence relation expressed by the above formula 
45 (32) and hence formula (33) below holds true. 

->l + (2 m -1) = - A+(2 m -1) (33) 

50 [0136] From the fact that 2 m * 1 - 1 refers to a data where ail the m bits are equal to "1 M , "-A + (2 m - 1 )" is expressed 
by means of the negation of A' as shown in FIG. 19B. 

[0137] Form the above discussion, it will be seen that the linear approximation circuit 68 only needs to obtain the 
negation of the lower m bits of A. Therefore, the linear approximation circuit 68 can carry out the operation of "-0.25 
IP - Ql + 2 m - 1" simply by inverting the data IP - Ql [m + 2 : 2] expressed by means of the m bits from the third lowest 
55 bit to the m+2-th lowest bit out of the absolute value data IP - Ql by means of the inverter 91 . 

[0138] Additionally, the linear approximation circuit 68 can see if "-0.25 IP - Ql + 2 m - 1" has a positive value or a 
negative value by obtaining the exclusive OR of the data IP - Ql [m + 3 : n] expressed by the n-m-2 bits from the m+3-th 
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lowest bit to the n-th bit out of the absolute value data IP - Ql. Therefore, since the correction term shows a positive 
value, the linear approximation circuit 68 can avoid any situation where the correction term shows a negative value by 
causing the selector 93 to output "0" when the exclusive OR obtained by the OR gate 92 is "1 " and hence the correction 
term is regarded to show a negative value as a result of computation. 
s [0139] If the coefficient a is expressed by means of -2' k , the linear approximation circuit 68 discards the bits from 
the lowest bit to the k-th lowest bit of the absolute value data IP - Ql for bit-shifting and inverting the m bits from the 
k+1 -th lowest bit to the m+k-th lowest bit. For example, if n = 5 and m = 2 so that the operation of "-0.25 IP - Ql + 3" 
is carried out, the absolute value data IP - Ql and the data Z will show the relationship as shown in Table 1 below. Note 
that Table 1 below additionally shows the above described negation of A', or the data output from the inverter 91 . 

10 

Table 1 





Relationship between Absolute Value Data IP - Ql and Data Z 




IP-QI 


A' 


z 


15 


31 


11111 


00 


0 




30 


11110 


00 


0 




29 


11101 


00 


0 




28 


11100 


00 


0 




27 


11011 


01 


0 




26 


11010 


01 


0 




25 


11001 


01 


0 


25 


24 


11000 


01 


0 




23 


10111 


10 


0 




22 


10110 


10 


0 


30 


21 


10101 


10 


0 




20 


10100 


10 


0 




19 


10011 


11 


0 




18 


10010 


11 


0 


35 


17 


10001 


11 


0 




16 


10000 


11 


0 




15 


01111 


00 


0 


40 


14 


01110 


00 


0 




13 


01101 


00 


0 




12 


01100 


00 


0 


45 


11 


01011 


01 


1 


10 


01010 


01 


1 




9 


01001 


01 


1 




8 


01000 


01 


1 


50 


7 


00111 


10 


2 




6 


00110 


10 


2 




5 


00101 


10 


2 


55 


4 


00100 


10 


2 


3 


00011 


11 


3 




2 


00010 


11 


3 
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Table 1 (continued) 



Relationship between Absolute Value Data IP - Ql and Data Z 


IP-QI 




z 


1 


00001 


11 


3 


0 


00000 


11 


3 



[0140] As shown in Table 1 above, the linear approximation circuit 68 outputs as data Z the data obtained by inverting 
the data IP - Ql [4 : 2] as expressed by 2 bits from the third lowest bit to the fourth (2 + 2 = 4) lowest bit out of the 
absolute value data IP - Ql by means of the inverter 91 for the range of the absolute value data IP-QI between 0 and 
12, whereas it outputs "0" for the range of the absolute value data IP - Ql not smaller than 13 because the output of 
the inverter 91 is negative in the latter range. 

[0141] Thus, the linear approximation circuit 98 can operate with bit-shifts and an inverter without requiring the use 
of a multiplier and an adder so that it can be estimated to show the delay of a selector. 

[0142] Therefore, the delay of the correction term computation circuits 65 is estimated to be equal to that of two 
adders and two selectors when the correction term computation circuit 68 is made to have the configuration as shown 
in FIG. 1 7, whereas the delay of the correction term computation circuit 65 is estimated to be equal to that of an adder 
and two selectors when the circuits are made to have the configuration of FIG. 1 8. 

[0143] Thus, in view of the fact that the processing operation of the comparator circuit 63 and that of the absolute 
value computation circuit 67 are carried out concurrently, the delay of the addition/comparison/selection circuit 60 is 
estimated to be equal to that of four adders and three selectors when the linear approximation circuit 68 is made to 
show the configuration of FIG. 1 7 and to that of three adders and three selectors when the linear approximation circuit 
68 is made to show the configuration of FIG. 18. In other words, while the addition/comparison/selection 60 originally 
involves the delay of three adders; it can determined the log likelihood I E practically without being affected by the delay 
of the correction term computation circuit 65. 

[0144] As described above, a data transmission/reception system comprising an encoder 1 and a decoder 3 can be 
made to operate quickly without sacrificing the performance because the decoder 3 can quickly determine the correction 
term when doing a log-sum correction by means of linear approximation. 

[0145] Thus, such a data transmission/reception system comprising an encoder 1 and a decoder 3 can decode 
convolutional codes highly effectively at high speed to provide the user with an enhanced level of reliability and con- 
venience. 

[0146] The present invention is by no means limited to the above described embodiment. For instance, the encoder 
may not be adapted to convolutional operations so long as it operates for coding with an appropriately selected cording 
ratio. 

[0147] Additionally, the present invention is applicable to any arrangement for decoding codes formed by concate- 
nating a plurality element codes such as parallel concatenated convolutional codes, series concatenated convolutional 
codes, codes of a Turbo-coding modulation system or codes of a series concatenated coding modulation system. 
[01 48] While the encoder and the decoder of the above described embodiment are applied respectively to the trans- 
mitter and the receiver of a data transmission/reception system, the present invention can also be applied to a recording 
and/or reproduction device adapted to recording data to and/or reproducing data from a recording medium such as a 
magnetic, optical or magneto-optical disc, which may be a floppy disc, a CD-ROM or a MO (magneto-optical) disc. 
Then, the data encoded by the encoder are recorded on a recording medium that is equivalent to a memoryless com- 
munication channel and then decoded and reproduced by the decoder. 

[0149] Thus, the above described embodiment can be modified and/or altered appropriately without departing from 
the scope of the invention. 

[0150] In so far as the embodiments of the invention described above are implemented, at least in part, using soft- 
ware-controlled data processing apparatus, it will be appreciated that a computer program providing such software 
control and a storage medium by which such a computer program is stored are envisaged as aspects of the present 
invention. 

[0151] Various different aspects and features of the present invention are defined in the appended claims. Combi- 
nations of features from the dependent claims may be combined with features of the independent claims as appropriate 
and not merely as explicitly set out in the claims. 
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Claims . 

1 . A decoder for determining the log likelihood logarithmically expressing the probability of passing a given state on 
the basis of the received value regarded as soft-input and decoding the input by using the log likelihood, said 

s decoder comprising: 

a linear approximation means for calculating a correction term to be added to the log likelihood, the correction 
term being expressed in a one-dimensional function relative to a variable; and 

said linear approximation means being adapted to compute said correction term using a coefficient represent- 
ee ing the gradient of said function for multiplying said variable, the coefficient being expressed as a power ex- 
ponent of 2. 

2. The decoder according to claim 1 , wherein said linear approximation means discards lower bits of the input data 
according to the power exponent expressing the coefficient representing the gradient of said function. 

15 

3. The decoder according to claim 2, wherein said linear approximation means discards the bits from the lowest bit 
to the k-th lowest bit of the input data when the coefficient representing the gradient of said function is expressed 
by -2" k . 

20 4. The decoder according to claim 1 , wherein said linear approximation means computes said correction term using 
the coefficient representing the intercept of said function, the coefficient being expressed as a power exponent of 2. 

5. The decoder according to claim 4, wherein said linear approximation means computes said correction term using 
the coefficient representing the intercept of said function, the coefficient being expressed as 2 m - 1 . 

25 

6. The decoder according to claim 5, wherein said linear approximation means discards the bits from the lowest bit 
to the k-th lowest bit of the n-bit input data and inverts the m bits from the k-th lowest bit to the m+k-th lowest bit 
when the coefficient representing the gradient of said function is expressed by means of -2" k . 

30 7. The decoder according to claim 1 , wherein said correction term shows a positive value. 

8. The decoder according to claim 7, wherein said linear approximation means makes the correction term equal to 
0 when a negative value is produced by computing said correction term. 

35 9. The decoder according to claim 1 , wherein said log likelihood is a log expression of said probability, using the 
natural logarithm. 

10. The decoder according to claim 1 , further comprising: 

40 a first probability computing means for computing for each received value a first log likelihood logarithmically 

expressing a first probability determined by the code output pattern and said received value; 
a second probability computing means for computing for each received value a second log likelihood logarith- 
mically expressing a second probability of getting to each state from the coding starting state in the time series; 
a third probability computing means for computing for each received value a third log likelihood logarithmically 

45 expressing a third probability of getting to each state from the coding terminating state in the inverted time 

series; and 

said second probability computing means and said third probability computing means having the linear ap- 
proximation means. 

so 11. The decoder according to claim 10, further comprising: 

a soft-output calculation means for calculating the log soft-output logarithmically expressing the soft-output 
in each time slot, using said first log likelihood, said second log likelihood and said third log likelihood. 

12. The decoder according to claim 11, wherein said log soft-output is a logarithmic expression of said soft-output, 
55 using the natural logarithm. 



13. 



The decoder according to claim 1 , wherein said log likelihood is determined by computations replacing the multi- 
plications for computing the probability by logarithmic additions and the additions for computing the probability by 
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logarithmic maximum value computations and computations of said function. 

14. The decoder according to claim 13, wherein a maximum a posteriori probability decoding operation is conducted 
on the basis of the Log-BCJR algorithm. 

15. The decoder according to claim 1 , wherein convolutional codes are decoded. 

16. A decoding method for determining the log likelihood logarithmically expressing the probability of passing a given 
state on the basis of the received value regarded as soft-input and decoding the input by using the log likelihood, 
said decoding method comprising: 

a linear approximation step for calculating a correction term to be added to the log likelihood, the correction 
term being expressed in a one-dimensional function relative to a variable; and 

said linear approximation step being adapted to compute said correction term using a coefficient representing 
the gradient of said function for multiplying said variable, the coefficient being expressed as a power exponent 
of 2. 

17. The decoding method according to claim 16, wherein said linear approximation step is adapted to discard lower 
bits of the input data according to the power exponent expressing the coefficient representing the gradient of said 
function. 

18. The decoding method according to claim 1 7, wherein said linear approximation step is adapted to discard the bits 
from the lowest bit to the k-th lowest bit of the input data when the coefficient representing the gradient of said 
function is expressed by -2" k . 

19. The decoding method according to claim 16, wherein said linear approximation step is adapted to compute said 
correction term using the coefficient representing the intercept of said function, the coefficient being expressed as 
a power exponent of 2. 

20. The decoding method according to claim 19, wherein said linear approximation step is adapted to compute said 
correction term using the coefficient representing the intercept of said function, the coefficient being expressed as 
2 m - 1 . 

21 . The decoding method according to claim 20, wherein said linear approximation step is adapted to discard the bits 
from the lowest bit to the k-th lowest bit of the n-bit input data and inverts the m bits from the k-th lowest bit to the 
m+k-th lowest bit when the coefficient representing the gradient of said function is expressed by means of -2" k . 

22. The decoding method according to claim 16, wherein said correction term shows a positive value. 

23. The decoding method according to claim 22, wherein said linear approximation step is adapted to make the cor- 
rection term equal to 0 when a negative value is produced by computing said correction term. 

24. The decoding method according to claim 16, wherein said log likelihood is a log expression of said probability, 
using the natural logarithm. 

25. The decoding method according to claim 16, further comprising: 

a first probability computing step for computing for each received value a first log likelihood logarithmically 
expressing a first probability determined by the code output pattern and said received value; 
a second probability computing step for computing for each received value a second log likelihood logarith- 
mically expressing a second probability of getting to each state from the coding starting state in the time series; 
a third probability computing step for computing for each received value a third log likelihood logarithmically 
expressing a third probability of getting to each state from the coding terminating state in the inverted time 
series; and 

said second probability computing step and said third probability computing step including the linear approx- 
imation steps. 

26. The decoding method according to claim 25, further comprising: 
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a soft-output calculating step for calculating a log soft-output logarithmically expressing the soft-output in 
each time slot, using said first log likelihood, said second log likelihood and said third log likelihood. 

27. The decoding method according to claim 26, wherein said log soft-output is a logarithmic expression of said soft- 
output, using the natural logarithm. 

28. The decoding method according to claim 16, wherein said log likelihood is determined by computations replacing 
the multiplications for computing the probability by logarithmic additions and the additions for computing the prob- 
ability by logarithmic maximum value computations and computations of said function. 

29. The decoding method according to claim 28, wherein a maximum a posteriori probability decoding operation is 
conducted on the basis of the Log-BCJR algorithm. 

30. The decoding method according to claim 16, wherein convolutional codes are decoded. 
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